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Signal Separation 

This invention relates to a method for separation of individual periodic source signals 
from a composite signal, and to computer apparatus and computer software to 
implement the method. 

5 Signals generated by many real-life sources can be characterised as periodic or almost 
periodic. Typical examples include: sounds generated by the propellers of ships, 
mechanical vibrations arising from rotating machinery and electrical signals as a result 
of a heart-beat. Such signals do not generally occur in isolation: multiple sources 
generating signals of the same nature (e.g. sound) are often present within the same 
10 environment and each will make its own contribution. Individual source signals may be 
similar or dissimilar in form but, regardless of this, discrimination between signals is 
likely to require more than straightforward monitoring of a detector response. The 
detector will respond to a composite signal which contains contributions from each 
source. In theory, the composite signal should be susceptible to mathematical analysis 

15 to retrieve its component parts. There are however many problems encountered in 
practice. 

Prior art analysis of a periodic composite signal is, in the first instance, dependent on 
estimation of the period of one or more of the signal components. The information that 
may potentially be available from an analysed signal has' motivated the development of 

20 many period estimation techniques. The shape (amplitude structure) and period of a 
signal can provide useful information about its source. Applications have proved 
numerous: machine condition monitoring, target classification and communications, to 
name but a few. If each periodic sound in a composite signal generated by rotating 
machinery can be isolated and ascribed to a particular source, then the operational 

25 nature of the sources can be individually monitored. Such monitoring can facilitate early 
diagnosis of a failing component, which in turn results in reduced downtime and repair 
costs. Detection and classification of a military target (e.g. a ship or submarine) is 
possible by analysis of the signals generated by its periodic emitters (e.g. propellers). 
Periodic modulation schemes are often used in telecommunications, and if multiple 
30 signals are transmitted on the same channel then analysis of the composite signal is 
clearly essential for decoding the individual messages. 

For all the above listed applications, it is important to be able to isolate individual 
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periodic signals (which will be referred to herein as component signals) from a 
composite signal. Each individual signal potentially contains vital information relating to 
its source. 

One technique for separating such signals makes use of multiple sensors to detect the 
5 composite signal. Data collected within these multiple channels is then subject to an 
analysis known as Blind Signal Separation (BSS). This requirement for multiple sensors 
can be a major disadvantage: for separating n signals, at least n sensors are typically 
needed. Clearly the practicality of BSS is limited in many cases, with the limitation 
becoming more severe if a large number of source signals are present. 

10 The goal of BSS methods is the recovery (separation) of a number of statistically 
independent signals given only sensor observations that are mixtures of the source 
signals together with noise and unwanted interference. The term "blind" is used to 
indicate that no prior assumptions are made concerning either the nature of the sources 
(beyond their statistical independence) or the manner in which their signals are 

1 5 combined. Description of BSS and some of its applications can be found in S. Haykin, 
"Unsupervised adaptive filtering, Volume 1 , Blind Source Separation", John Wiley and 
Sons, 2000 and A. Hyvarinen, J. Karhunen and E. Oja, "Independent Component 
Analysis", John Wiley and Sons, 2001. BSS makes use of the spatial characteristics 
(e.g. arrival direction) of each signal in order to separate component signals. 

20 Given the practical limitations of providing multiple, separated sensors, techniques have 
also been developed for separating a composite signal detected at a single sensor 
position. Most prior art period estimation methods in fact exploit their potential for 
single-sensor analysis, making use of techniques like the Fourier transform. This is 
generally applied by the use of comb filters, which are tailored for application to periodic 

25 signals. 

Period estimation techniques aim, for each individual source signal present, first to 
provide an estimate of its period and then to extract an approximation to the shape of its 
base repeating unit. This base unit is the smallest repeating unit within the signal and it 
will be referred to herein as a "eyelet". If a signal is modulated by an amplitude envelope 
30 then the amplitude of each eyelet will vary as it repeats. Such modulations occur, for 
example, if a communication signal is sent on a carrier wave or if a heart-beat is affected 
by exercise and each beat has a different strength. If multiple periodic signals are 
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present in the composite data then each individual signal is generally detected, 
estimated and subtracted in turn, until only noise remains. Most calculations are 
performed on a digitally sampled signal and hence the period may be measured in terms 
of the number of sample points that the eyelet spans. 

5 Further examples of modulating amplitudes can be found in: Y. Medan, E. Yair and D. 
Chazan, "Super Resolution Pitch Determination of Speech Signals", IEEE transactions 
on Signal Processing, Vol. 39, N0.1, January 1991 in which periodic components of a 
speech signal are modelled with a varying scaling; M. Feder, "Parameter Estimation 
and Extraction of Helicopter Signals observed with a Wide-Band Interference", IEEE 

10 transactions on Signal Processing, Vol. 41, N0.1, January 1993 in which helicopter 
acoustic signals are modelled with a varying scaling; and P. P. Kanjilal, S. Palit and G. 
Saha, "Fetal EGG Extraction from Single Channel Maternal ECG using Singular Value 
Decomposition", IEEE transactions on Biomedical Engineering, Vol. 44, N0.1, January 
1 997 in which heart-beat signals are modelled with a varying scaling. 

15 One technique used in the prior art to derive an estimate of the period of a signal is 
known as synchronous averaging. This technique is based on the concept that period 
likelihood estimators can be used to measure the "strength" of period correlation for a 
range of period test values. It therefore requires an initial, evaluation of a measure of 
likelihood for each of many test values of the period. The test value that results in the 

20 highest likelihood (or correlation) may be used as an estimate of the true period: 
however, coherent integration can occur at multiples of the true period in addition to the 
true period itself. In these cases averaged segments will contain multiple lengths of the 
eyelets and coherent integration will occur. To avoid problems of identifying a 
fundamental period at multiples of a true period, the search commences at lower 

25 periods. This search method is referred to as the small-to-large method and is described 
in W.A. Sethares and T.W. Staley, "Periodicity transforms", IEEE transactions on Signal 
Processing, 47(1), January 1999). There are also other search strategies mentioned in 
this paper. The signal is then partitioned in the time domain into eyelets of the estimated 
period and successive partitions averaged to obtain an estimate of their shape. 

30 Synchronous averaging is described by M. Feder in the reference cited above. 

The comb filter makes use of the principle that a periodic signal can be considered as 
being made up of basis periodic components at a fundamental frequency and multiples 
thereof. In the frequency domain, this method is equivalent to multiplying the Fourier 



WO 2004/055718 



PCT/GB2003/005285 



4 

transform of a signal with a filter that passes only the fundamental and harmonic 
frequencies of test periods. An example implementing this method is described by A. de 
Cheveigne and H. Kawahara in "Multiple period estimation and pitch perception model", 
Speech Communication, 27, 175 - 185, 1 999. 

5 A third technique that may be used in the estimation process is singular value 
decomposition (SVD). Period SVD uses the same principle as synchronous averaging 
in that it first partitions a sampled signal in the time domain in accordance with a number 
of test periods. Instead of then averaging, an SVD is performed on the partitioned data. 
Partitioned segments are then combined Using a weighted average and, at the correct 

10 test period, will integrate coherently. Period SVD has the additional benefit that the 
modulation envelope (scaling of successive eyelets) of a periodic signal is estimated 
along with the period. An example of its application is presented in the Kanjilal et al 
reference, cited above. 

Many more examples of detection, estimation and separation of multiple periodic signals 
1 5 detected at a single sensor are found in the prior art. For example, see W.A. Sethares 
and T.W. Staley, "Periodicity transforms", IEEE transactions on Signal Processing, 
47(1), January 1999; V.P. Strokes, H. Lanshammar and A. Thorstensson, "Dominant 
pattern extraction from 3-D kinematic data", IEEE transactions on Biomedical 
Engineering, 46(1), January 1999. 

20 Every periodic signal can be considered as being made up of basis Fourier components 
at a fundamental frequency and at multiples of this fundamental (its harmonics). If 
periodic signals share common Fourier harmonics, this is termed "overlap" in the 
frequency domain and signal leakage can occur. At the extreme, most significant 
overlap occurs if individual source signals within a composite signal have the same 

25 period. 

All the above-mentioned prior art decomposition techniques suffer from the fundamental 
problem that their accuracy is markedly decreased if component periodic signals overlap 
in the frequency domain. This arises because they are all based on using the signals* 
periods as the primary discriminant. For example, when using a comb filter, if there is 
30 no frequency overlap then basis Fourier components at the fundamental frequency and 
harmonics will contain information relating to only one source signal. Combining the 
fundamental plus harmonics to reconstruct this source is therefore effective regardless 
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of the presence or absence of other (different-frequency) signal components within the 
data. If overlap is present however then the process is not so clear cut. Very little 
distinction is available between basis Fourier components of different individual signals 
(originating from different sources), but which occur at the same position in the 

5 frequency domain. The principle of repeatedly subtracting individually detected and 
estimated signals is no longer valid as each estimated signal will contain components 
(leakage) from other source signals. Such a scenario arises when the periods of 
component signals within the composite data are not coprime. The term "coprime" 
means that the highest common factor between two positive integers (in this case the 

1 0 periods in sample point units) is one. That is, signal leakage will occur when the periods 
of one or more component source signals are, for example, the same or when one 
period is a multiple of the other. The problem is discussed by Z. Mouhan, C. Zhenming 
and R. Unbehauen; "Separation of periodic signals by using an algebraic method", IEEE 
ISCAS-91 , 5 pp 2427 - 2430, 1991 . In this paper the authors highlight the inapplicability 

15 of their method to separating signals that are not coprime. 

It has to be borne in mind as well that as signals are digitally sampled for analysis, the 
signals need not be coprime only to the resolution of the sampling frequency for the prior 
art separation methods to break down. That is, signals of, for example, approximately 
equal periods, or approximately equal multiples, will also appear indistinguishable. 

20 This fundamental problem is not readily ignored as it is indeed the case that in many 
real-life situations, two or more component source signals will often occur with the same 
or similar periods. For example, if different parts of machinery rotate at the same speed 
then separate source signals will be generated at the rotation frequency. Similarly, if a 
signal reaches a sensor by multiple routes from its point of origin (multi-path), the overall 

25 received signal will be a combination of signals with the same period but having 
traversed different path lengths. Each path effectively gives rise to one perceived 
source and the combined signal is difficult to decompose into its individual components. 
Target classification is complicated in that the combined signal will not correspond to 
any known or actual signature. This problem is analysed in H. Amindvar and P.P. 

30 Moghaddam, "Estimation of propeller shaft rate and vessel classification in a multi-path 
environments", IEEE Proceedings of Sensor Array and Multi-channel Signal Processing 
Workshop, pp. 125 - 128, March 2000. In communications, optimal use of bandwidth is 
achieved if multiple signals are transmitted on the same carrier frequency. Again the 
problem of separating individual messages with the same period is encountered. It 



WO 2004/055718 



PCT/GB2003/005285 



6 

would go some way to providing a complete process for signal analysis if, in the first 
instance, signals of equal or approximately equal periods received at a single sensor 
could be separated. 

In one attempt to avoid this type of problem a novel method of period estimation for 
5 communication signals was proposed by B. Santhanam and P. Maragos in "Harmonic 
analysis and restoration of separation methods for periodic signal mixtures: algebraic 
separation versus comb filtering", Signal Processing, 69 pp. 81 - 91, 1998. Their 
approach exploits prior knowledge of the shapes of the periodic signals. Unfortunately, 
in most period estimation problems the shapes are unknown and so despite being found 
10 to enhance the detection and separation process, this method is of limited applicability. 

In summary therefore, when periodic signals significantly overlap in the frequency 
domain, the performance of existing period estimation techniques is degraded in two 
ways. Degradation is most severe when the signals have the same period. At a first 
stage of analysis, the ability to even detect the presence of two signals is limited. If two 

1 5 signals having the same period are mixed, then only one may be detected using period 
discrimination alone. At a second stage, there is reduced capacity for signal separation. 
In general, the estimated separated signal will be a linear combination of the actual 
individual source signals. Current techniques to overcome this problem make use of an 
alternative discriminant: either arrival direction at multiple sensors- or the requirement of 

20 some foreknowledge of the shapes of the periodic component of the signals. Both of 
these techniques have significant disadvantages which prevent them from being 
universally applicable. 

There is a perceived need for a novel signal separation technique that is capable of 
separating .individual source signals from composite data collected at a single sensor 
25 even in situations in which two or more source signals have very similar periods. 

Accordingly the present invention provides a method of separating a plurality of source 
signals from a composite signal expressed as a series of values of signal amplitude, 
each source signal having a respective period similar or equal to p, characterised in that 
30 the method incorporates the steps of: 

a) expressing the composite signal as a matrix X having rows each of which is a 

respective segment of signal amplitude values and corresponds to a length of time 

associated with a signal eyelet; 
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b) implementing a decomposition of the matrix X by decorrelation and normalisation to 
obtain decomposition results; and 

c) performing independent component analysis (ICA) of the decomposition results to 
obtain at least one of estimated separated signal modulation envelopes and 

5 estimated separated signal eyelets. 

The invention provides a technique by which a composite signal detected at a single 
sensor can be separated into individual component source signals. This therefore 
avoids the requirement for multiple sensors and, unlike prior art signal separation 
techniques, is specifically able to separate signals with the same period from the 
1 0 composite. 

The decomposition of the matrix X is preferably a singular value decomposition (SVD) 
generating decomposition results comprising two singular vector matrices and a singular 
value matrix, and the step of performing ICA is preferably carried out using one of the 
singular vector matrices to obtain at least one of an independent component matrix and 
15 an associated component matrix one of which matrices contains estimated separated 
signal modulation envelopes and the other contains estimated separated eyelets. 

Source signal period may be determined by trialling a number of possible periods p', 
steps (a) and (b) being carried out for each possible period p'to derive and decompose 
a respective matrix Xtest, each matrix X tes t having a probability associated with its 

20 decomposition results, and step (c) being carried out with decomposition results of that 
matrix X les t having maximum probability and taken to be the matrix X. If coherent 
integration occurs at multiples of a period, a search may commence at lower periods 
using the small-to-large method described in the W.A. Sethares reference mentioned 
previously. This method makes use of period SVD in an entirely novel signal separation 

25 problem. It provides the advantage of robustness to negative amplitudes in estimating a 
period within a composite signal, something that is not achieved by alternative prior art 
period estimation techniques. 

Alternatively, the period p may be estimated by synchronous averaging of the composite 
signal. Although this method is not as robust as period SVD, it is more computationally 
30 efficient. 

The signal modulation envelopes may be more statistically independent than the eyelets, 
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and if so step (c) is performed on a singular vector matrix U to obtain an independent 
component matrix UR 2 T containing estimated separated signal envelopes and a matrix 
R 2 XV containing estimated separated eyelets. The eyelets may alternatively be more 
statistically independent than the signal envelopes, and if so step (c) is performed on a 
5 singular vector matrix V to obtain an independent component matrix R/V containing 
estimated separated eyelets and a matrix UARi containing estimated separated signal 
envelopes. These two alternatives allow the method to be adapted to applications in 
which different aspects of the signals to be separated are statistically independent. 

The method of the invention may include an additional step of estimating a number q of 
1 0 source signals with periodicities similar or equal to p present within the composite signal 
and reducing the decomposition results in accordance with such number prior to 
performing step (c). This provides the advantage of reducing the computations 
necessary in carrying out the ICA stage of this invention. The number q of source 
signals may be estimated from the source signals' origins, or alternatively from a number 
15 of elements of a singular value matrix A., the elements having values exceeding a 
threshold value. 

The composite signal may be detected by a single sensor. Alternatively, the source 
signals may be detected by a plurality of sensors each of which provides a respective 
composite signal from which a respective matrix X is obtained and analysed in steps (a) 
20 to (c). As a further alternative, source signals may be detected by a plurality of sensors 
providing respective composite signals, the matrix X being obtained from the composite 
signals collectively. 

The invention may be a method of apparatus condition monitoring, the source signals 
being obtained with the aid of at least one sensor from a plurality of apparatus sources, 
25 and the at least one of estimated separated signal modulation envelopes and estimated 
separated signal eyelets being analysed for indications as to the condition of respective 
apparatus sources. 

In an alternative aspect, the present invention provides computer apparatus for 
separating a plurality of source signals from a composite signal expressed as a series of 
30 values of signal amplitude, the source signals having periodicities similar or equal to p, 
characterised in that the computer apparatus is programmed to: 

a) express the composite signal as a matrix X having rows each of which is a 
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respective segment of signal amplitude values and corresponding to a length of time 
associated with a signal eyelet; 

b) decompose the matrix X by decorrelation and normalisation to obtain decomposition 
results; and 

5 c) perform ICA of the decomposition results to obtain at least one of estimated 
separated signal modulation envelopes and estimated separated signal eyelets. 

In a preferred embodiment of this alternative aspect, the present invention provides 
computer apparatus arranged to separate a plurality of source signals from a composite 
signal expressed as a series of values of signal amplitude, the source signals having 
10 periodicities similar or equal to p, characterised in that the computer apparatus is 
programmed to: 

a) partition the composite signal into aplurality of partition matrices X having rows each 
of which is a respective segment of signal amplitude values and corresponds to a 
length of time associated with a signal eyelet; 
15 b) perform an SVD of at least one of the matrices X to obtain two singular vector 
matrices U, V/and a singular value matrix X; 

c) estimate a true period p of the source signals from an average of data within rows of 
the partition matrices X\ and 

d) perform an independent component analysis of one of the singular vector matrices 
20 U t V generated by SVD from the matrix X partitioned in accordance with the 

estimated period p and so to obtain an independent component matrix UR 2i R/V 
and an associated component matrix R 2 \V, UkR 1 characterised in that one 
component matrix UR 2 \ UkR 1 contains estimated separated signal modulation 
envelopes and the other R 2 \V, R^V contains estimated separated eyelets. 

25 In a further alternative aspect, the present invention provides a computer-readable 
medium embodying instructions for execution by a computer processor, the instructions 
relating to separation of a plurality of source signals from a composite signal (104) 
expressed as a series of values of signal amplitude, the source signals having 
periodicities similar or equal to p, characterised in that the computer-readable medium 
30 incorporates program code for controlling a computer processor to: 

a) express the composite signal as a matrix X having rows each of which is a 
respective segment of signal amplitude values and corresponds to a length of time 
associated with a signal eyelet; 
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b) decompose the matrix Xby decorrelation and normalisation to obtain decomposition 
results; and 

c) perform ICA of the decomposition results to obtain at least one of estimated 
separated signal modulation envelopes and estimated separated signal eyelets. 

5 In a preferred embodiment of this further alternative aspect, the present invention 
provides a computer-readable medium embodying instructions for execution by a 
computer processor, the instructions relating to separation of a plurality of source 
signals from a composite signal expressed as a series of values of signal amplitude, the 
source signals having periodicities similar or equal to p, characterised in that the 
1 0 computer-readable medium incorporates program code for: 

a) partitioning the composite signal into sections to provide respective rows of a 
partition matrix X; 

b) performing an SVD of the matrix Xto obtain two singular vector matrices U, Vand a 
' singular value matrix X; and 

15 c) performing an ICA of one of the singular vector matrices U, V to obtain an 
independent component matrix UR 2 T , Ri T V and an associated component matrix 
R 2 XV, UkR, characterised in that one matrix UR 2 T , UkRi contains estimated 
separated signal modulation envelopes and the other matrix R 2 kV, R/V contains 
estimated separated eyelets. 

20 Embodiments of the invention will now be described by way of example only and with 
reference to the accompanying drawings. 

Figure 1 is a schematic illustration of an application of the method of this invention to 
machine condition monitoring. 

Figure 2a is a schematic representation of a periodic signal. 

25 Figure 2b is a schematic representation of a periodic signal with varying modulations. 

Figure 3 is a representation of the formation of a mathematical model of a periodic 
signal with varying modulations. 

Figure 4 is a representation of the formation of a mathematical model of multiple 
periodic signals with varying modulations. 

30 Figure 5 is a flow chart illustrating the steps involved in implementing a first embodiment 
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of a method of this invention. 

Figure 6 is a representation of source eyelets used to generate data for an example 
implementation of a method of this invention. 

Figure 7a is a graphical plot of a single periodic signal with varying modulations. 

5 Figure 7b is a graphical plot of a composite signal containing three periodic signals with 
varying modulations, each of the same period and generated from the eyelets illustrated 
in Figure 6. 

Figure 8 is a plot of the combination of the envelopes of the three periodic signals 
plotted in Figure 7. 

1 0 Figure 9 is a plot of estimated source eyelets extracted from the data plotted in Figure 7 
by a partial implementation of a method of this invention. 

Figure 10 illustrates plots of estimated amplitude envelopes extracted from the data 
plotted in Figure 7 by a partial implementation of a method of this invention. 

Figure 1 1 is a plot of estimated source eyelets extracted from the data plotted in Figure 7 
.15 by a full implementation of a method of this invention. 

Figure 12 illustrates plots of estimated amplitude envelopes extracted from the data 
plotted in Figure 7 by a full implementation of a method of this invention. 

Figure 13 is a scatter plot illustrating graphically the processes carried out by a method 
of this invention in separating signals of the same or similar periods. 

20 Figure 14 is a schematic illustration of a computer system arranged to implement 
another aspect of this invention. 

Figure 15 is a representation of the formation of a mathematical model of multiple 
periodic signals with varying modulations detected at two sensors. 

Figure 1 6 is a series of four plots that illustrate the ability of a method of this invention to 
25 separate signals whose start times are misaligned. 

Figure 1 shows a schematic illustration of the stages involved in a method of machine 
condition monitoring in accordance with an aspect of this invention. In the arrangement 
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shown in this Figure, signals generated by three sources 10a, 10b, 10c of machinery 
rotating at the same speed are detected at a sensor 1 2. In one embodiment, the sensor 
12 is a microphone that detects the sound of the rotating machinery 10a, b, c. In 
another, it is an accelerometer, which detects its vibration. In either case, the detected 

5 signal is converted by the sensor 12 (microphone or accelerometer) to an electrical 
signal. The precise nature of the signals themselves is not important/' What is 
significant is that they originate from multiple sources and are periodic, or near periodic, 
with potentially more than one signal characterised by a given period. In the scenario 
shown in Figure 1 the structure of the recorded signal may be complex. Signals with the 

10 same period are present from different machinery components rotating at the same 
speed. 

As shown in Figure 1 , the process of machine condition monitoring can be broken down 
into four stages. The (composite) output signal from the sensor 12 is recorded and 
digitised at a data acquisition stage 14. This is followed by a signal separation stage 16 

15 at which the composite signal is decomposed into its component parts. At an analysis 
stage 18 the individual signal components are analysed, for example for signs that the 
machinery 10a, 10b, 10c may have developed a fault. There are many existing analysis 
methods that can be applied to a single source signal to the benefit of machine condition 
monitoring. Examples are given by N. Arthur, J. Penman, A. McClean and A. Parsons in 

20 "Induction machine condition monitoring with higher order spectra I. Fundamentals and 
fixed frequency operation", IEEE 24 th annual conference of the Industrial Electronics 
Society pp. 1889 - 1894, September 1998. Finally, if a fault is detected, corrective 
action is taken at a fault correcting stage 20. Depending on the fault, the source may be 
replaced or adjustments made to the machinery in order to reduce the operational stress 

25 on the source. 

It is to be noted that the first three stages above, namely data acquisition 14, signal 
separation 16 and data analysis 18, are common to all problems involving multi-source 
(or composite) signal analysis. The novelty of this present invention lies in the signal 
separation stage 16 of analysis. The specific problem of machine condition monitoring 
30 is therefore used herein for illustrative purposes only and is not in any way to be 
considered limiting. This invention, in its broadest aspect, as will become apparent, has 
far wider application to any area of composite signal analysis. This is furthermore not 
limited to composite signals containing two or more components at the same period; it is 
in this area however that improvements over the prior art will be most apparent. In other 
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words, the novel technique of this present invention, which is capable of separating 
signal components of the same period can be applied more generally to a composite 
signal containing multiple components of the same and different periods. Prior art 
analysis techniques are first applied to extract the different-period components before 
5 application of a second analysis technique to each extracted component in order to 
separate same-period components hidden within. For clarity only therefore, it is 
assumed in this embodiment of the invention that different-period components are 
absent from the composite signal. 

Typical structures of periodic signals are illustrated schematically in Figure 2. In order to 
1 0 provide a mathematical basis for the signal processing carried out by this invention, it is 
necessary to set up a model for this structure. Figure 2a is an schematic representation 
of a perfect periodic signal 26 with period p expressed in units of a sampling interval t, 
so p implies pr. Four repeating units (eyelets) 28a, b, c, d, each extending through one 
period p are shown. The signal is digitised and so each eyelet 28 can be represented by 
15 p sample points, each having a particular amplitude c„, n being a sampling index 
parameter (sample number). With reference to one eyelet 28a, this can be represented 
mathematically as a column vector: 



c = 



C 3 



Or, in shorthand, eyelet 28a can be represented as (p x 1 ) c indicating a (p x 1) vector. 

20 A more general quasi periodic signal 30 is represented in Figure 2b. Again four eyelets 
32a, b, c, d are shown, each spanning one period p of the signal 30. This signal 30 
however is modulated by a time-varying envelope. As a result each eyelet 32a, b, c, d is 
scaled by a different amount: a first eyelet 32a by a factor a1 , a second 32b by a2, a 
third 32c by a3, a fourth 32d by a4, and so on. In effect, the modulation envelope can 

25 be considered sampled by each eyelet at its peak position. If the modulation envelope is 
sampled k times within the segment that is analysed, a representation of the complete 
signal can be generated by consideration of a block of k repeated eyelets. Modulation 
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can be either smoothly-varying (as in amplitude modulation of a carrier wave) or 
discontinuous, by which it is meant that different and unrelated scaling factors are 
applied to successive eyelets (as, for example, in a heart-beat). In either case, the 
modulation envelope of a signal can provide vital information about its source. For 
5 example, in the situation described in relation to Figure 1, if a piece of rotating 
machinery develops a fault, the fault may cause the machinery to come into contact with 
other machinery. Friction will increase and so more energy will be emitted by the 
source. This energy is in the form of ah altered modulation envelope to the signal. 

Figure 3 is a representation of how an individual source signal is partitioned for 
10 processing by the method of this invention. In Figure 3a there are shown k eyelets 32a, 

32b, 32k (referred to generally as 32), each of period p, and collectively forming a 

block of eyelets 34 defining a first source signal. The modulation envelope sampled at 
the peak of each eyelet 32a-k has amplitude aim, where the "1" index indicates 
association with the first source signal and the "rrf indices (m = 1, 2, ..k) indicate 
1 5 respective individual eyelets 32a, 32b 32k within the block of k eyelets 34. 

Figure 3b illustrates and indicates various forms in which the block of k eyelets 34 can 
be represented as a matrix X. A graphical representation 36 is shown towards the left 
hand side. The eyelets 32 each with its respective scaling factor aim, are partitioned 
and arranged vertically in a column 36, each eyelet (or strictly speaking the digital values 
20 defining it) being a respective row of X. As there are p sample points within each eyelet, 
and k scaling factors, X is a (k x p) matrix. Although each row of X is a eyelet, it is not 
essential (but convenient) that each row contain all p sample points of a eyelet. Instead 
alternate sample points or a more sparse equivalent could be used for a row if it were 
necessary to reduce the processing burden. 

25 A mathematical representation 38 has the scaling factors written as a column vector, 
each multiplied by c T , where c T denotes the transpose of the (p x 1) eyelet vector c. If 
at is a (k x 1) vector representing the sampled points of the scaling envelope: 

"all" 
« a12 

a\k 
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then, mathematically, for a single source signal: 

X=a1.c r (1) 

As an aid to understanding, the (1 x p) vector c T is represented graphically by the eyelet 
profile 32 in a third representation of Xal 40. 

5 In Figure 4 the representation of Figure 3 is extended to two periodic signals, which 
have equal periods p. In Figure 4a, as before, the first source signal 34 is shown as a 

block of k eyelets 32a, 32b, , 32k, each of period p, and with amplitude aim, where 

"ni' (m = 1 to k) indexes each of the eyelets 32a-k. A second source signal 42 is also 
shown as k eyelets 44a, 44b 44k, each of period p, but with a second profile 44. 

10 The modulation of this signal 42 is however different. Sampled at the peak of each 
eyelet 44a-k the modulation envelope has amplitude a2m, where the "2" index indicates 
that this is the second source signal and "nrf indexes each of the eyelets 44a to 44k. 

Using the same partitioning model as before, the matrix X is shown in Figure 4b: it 
represents a composite signal consisting of a combination of the first 34 and second 42 
15 source signals. Scaling amplitudes aij are now written into a (k x 2) matrix 46 and the 
two eyelet profiles (cj and Cg), one above the other, into a second matrix 48. 
Mathematically, the matrix X can be expressed as: 

X = AC = Xa,c[ (2) 

where 3 is a (k x 1) vector which contains the modulation amplitudes (scalings) of the Ah 
20 eyelet and c, T is a (1 x p) vector which contains the eyelet profile of the Ah periodic 
signal. Accordingly, A is a (k x 2) matrix containing the envelopes of the two periodic 
signals in respective columns and C is a (2 x p) matrix containing the sampled eyelet 
profiles of these signals along respective rows. 

When signals with the same period are present within a composite signal, their 
25 modulation envelopes will combine. The matrix A is therefore known as the mixing 
matrix as its coefficients operate on the source signals to form the received signal. 

Three distinct pieces of information are contained within the matrix X: the size of its 
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rows (i.e. the period p of the source signals), the modulation envelopes (within A) and 
the eyelet profiles (within C). 

Figure 5 is a flow chart representation of the stages involved in separating signals in 
accordance with this invention. The separation process 16 will be referred to as the 

5 Blind Period Method (BPM). In applying BPM, it is assumed that the periods of the 
source signals will be constant over the duration of the window used for detection and 
separation and also that synchronous sampling conditions will apply. That is, the 
periods will be integer-valued and the sampled points on each successive eyelet will be 
the same. It is to be noted that sampling rates may be varied to ensure that this latter 

10 condition applies. For example, a sample rate at which the period of a signal is 
measured at 89.25 samples can simply be increased by a factor of 4. This allows the 
period to be expressed as 357 samples at the new rate. 

The BPM essentially divides into three stages: a data partition stage 60, a Singular 
Value Decomposition (SVD) stage 62 and an Independent Component Analysis (ICA) 

1 5 stage 64. In a first embodiment, period estimation is carried out at the SVD stage 62. In 
further embodiments a different method is used to carry out the period estimation prior 
to the SVD stage 62. In these embodiments the SVD stage 62 is only performed on 
data partitioned in accordance with this estimated period. It is not essential to carry out 
an SVD: any process of a similar kind carrying out decorrelation and normalisation can 

20 be used instead, but SVD is well-known and convenient. 

In any embodiment of the analysis in accordance with' the present invention, a 
datastream has been acquired in the form of signal amplitudes at a large number of 
sample times, of which adjacent pairs of sample times are separated by a constant 
sample time interval x as is conventional. It is assumed that multiple sources contribute 
25 to the signal but that they have periods which are equal to p or nearly so. 

With reference to Figure 5, in this first embodiment of the analysis method of this 
• invention a first step 66 is, for each one of a set of test periods p', to format the 
datastream in the form of a matrix X, est . That is, for each value of the period p', the first 
p' sampled amplitudes are written across the matrix X, es t in the first row. The next p' 
30 sampled amplitudes are written in the second row and so on until the matrix is complete 
at row k'. 
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At step 68, SVD is carried out on the (k* x p') matrix X tes t. SVD is a decorrelation and 
normalising method and is a well-known analytic technique. The SVD of a general 
matrix X (assuming rank k) can be expressed as: 

X= UAV (3) 



5 where U is a (k x k) matrix and V is a (k x p) matrix: U and V are orthonormal, i.e 
columns of U are mutually orthogonal vectors which are normalised, and this also 
applies to rows of V\ X is a (k x k) diagonal matrix (i.e. all off-diagonal elements are zero) 
with real elements (singular values) arranged in decreasing order down its diagonal. 
The columns of Uare left orthonormal singular (temporal) vectors and the rows of Vare 
1 0 right orthonormal singular vectors. 

It is important to understand what is achieved in carrying out an SVD on a matrix formed 
from the datastream of signal amplitudes. It is helpful in considering this to assume that 
the matrix X has been derived by correct partition of the datastream in accordance with 
the true period p of component signals present within. If partitioned in accordance with 
15 this period p it is assumed that the datastream fills k rows within matrix X. The way in 
which the SVD of a set of matrices partitioned in accordance with a set of test periods 
leads to an indication of the true period will be explained later. 

In carrying out the SVD of the matrix X, the decomposition essentially obtains U, a 
matrix of amplitudes and I/, a normalised waveform (each is normalised to unit power). 
20 In full, assuming rank k: 
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By multiplying out the first pair of matrices (U and X), it can be seen that the values 
within the k columns are preserved, with the addition of a multiplicative factor a n , where 
n is the number of the column. Comparison of this (and equation (3)) with Figure 4b 
25 (and equation (2)) reveals that the columns of U above correspond to the columns of the 
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matrix A in equation (2) and the rows of V above correspond to the rows of the matrix C. 
That is, information relating to the eyelets (c,) is contained in the rows of V and 
information relating to the modulation envelopes (aj) is contained in the columns of U. 
The singular values within X indicate the strength of their interaction i.e. the strength of 

5 the estimated source signals. If the singular values are arranged in decreasing order, 
later columns in the UX matrix will rapidly tend to zero - limiting the number of source 
signals found. In the event that q of the singular values are non-zero (q < k), or can be 
considered as being above a threshold value, then U reduces to a (k x q) matrix, V 
denotes a (q x p) matrix and X denotes a (q x q) matrix. If q = 2, the comparison with 

1 0 Figure 4b is evident. 

Returning then to step 68 shown in Figure 5, it can be seen that, for each test period p', 
performing SVD on the resulting matrix X test obtains sets of matrices U, Vand X. Within 
the matrices V, each row comprises a weighted average of the relevant segment. At 
step 70 the rows within each matrix V are added together. At the correct test period 

15 p' = p, integration will be coherent, as the summation will inevitably include repeated 
eyelet profiles. If the test period is not equal to the true period, non-coherent integration 
results in a significantly lower average value. In this way a likelihood estimator or 
probability is obtained for each value of the test period. The search commences at a 
low test period and increments systematically. Peaks will occur in a plot (referred to as 

20 a period likelihood estimate) of test period against segment average intensity when 
coherent integration occurs. That is, when the test period is equal to, or a multiple of, 
the true period. An estimate of the true period p is therefore obtained at this step 70. As 
a final step 72 of this period SVD stage 66, the decomposed matrices U, y and X that 
correspond to the matrix X partitioned in accordance with the true test period are 

25 extracted in preparation for the ICA stage 64 of the BPM. 

It is not known in the prior art to apply SVD to the problem of separating signals with the 
same periods from a single-sensor datastream. In fact, it is only known that SVD may 
be applied to extract component signal periods from a composite signal. This feature is 
taught by the period SVD method of Kanjilal et a/., whose method is directed at signal 
30 separation when the periods may be coprime. The above-described partition 60 and 
SVD 62 stages essentially follow this period SVD method but with the crucial difference 
that it is applied to data in which at least two component signals have the same period. 
This present invention is based on the realisation that if a single-channel datastream, 
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representing values collected in the time domain, is partitioned in the manner described 
herein to form a matrix such as X, then the formerly unsolvable problem of separating 
signals of the same period collected in a single channel becomes solvable. 
Mathematically, it is in fact analogous to a problem that has been solved in the spatial 

5 domain, although far less intuitive to set up. That is, detecting a composite signal 
simultaneously at a number of detectors is more naturally written in matrix format, each 
row of the matrix corresponding to sampled composite signal values in a particular 
detector channel. For example, if two signals arrive at multiple sensors (at the same 
time) then the mixing model may be expressed as a combination of two amplitudes 

1 0 (scalings at each sensor) multiplied by the two signal components: 

X = MS = £m,s[ 

/=i 

where the vector m, denotes the scalings of the Ah signal at each sensor and s7 denotes 
the shape of the Ah signal. It is known that this problem (i.e. extracting M and S from a 
matrix X formed from multi-channel datastreams) can be solved in the spatial domain by 
1 5 application of SVD and ICA (by BSS). It is not known that an analogous problem exists 
and can be solved in the time domain. The solution in a time domain is the subject of 
this invention. 

As mentioned previously, it is known in the prior art that a SVD of the matrix X will not 
generally reproduce true signals in the spatial domain. Similarly it does not, in itself, 
20 reproduce true signals in the time domain. This can be seen by reference to the 
example to be described with reference to Figures 6 to 12. Data within these examples 
has been simulated. It is representative of the situation illustrated in Figure 1 , but is also 
generic to any application in which signals of the same period are mixed. 

Figure 6 is a plot 100 of three source eyelets jCj, eg, eg, each of which belongs to a 
25 different periodic signal. The eyelets £!, Cg, eg have the same period (40 sample points) 
and, although different, are highly correlated, as evidenced by their similar shapes. 

Figure 7a is a plot of a section of a signal 1 02 based on one of the source eyelets Cj. 
Over a length of time the eyelet Cj is replicated a number of times, with scaling in 
accordance with a signal modulation envelope. In this example, the modulation 
.30 envelope corresponds to a real acoustic signal. The plot is generated by concatenating 
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rows of the (k x 40) matrix X = the modulation envelope being contained in the 

(k x 1 ) vector aj and the eyelet profile in the (1 x 40) vector c/. 

A segment of a composite signal 104 generated by mixing three signals, each based on 
one of the source eyelets c,, Cg, Cg is plotted in Figure 7b. Within the time series shown, 
each eyelet Cj, Cg, Cg is replicated a number of times and source signals 102 are each 
modulated by a different envelope, which corresponds to a real acoustic signal such as 
speech or music. The composite signal 104 is generated by concatenating the rows of 
the (kx40) matrix X: 



X = [a t a 2 a 3 ] 



c T 

— 1 

c T 

— 2 

c T 

— 3 



(5) 



10 The (k x 1 ) vectors a,, a* ag contain the actual acoustic signals (speech and music) and 
the (40 x 1) vectors Cj, Cg, Cg contain the eyelet profiles. 

Figure 8 is a plot of a composite acoustic signal 106, representing the mixing of the 
three envelopes . A single column of the composite matrix X represents a series of 
sample points taken on the composite envelope at the same position on the eyelet. The 
15 composite acoustic signal 106 is accordingly generated by plotting values found in a 
single column of X as a time series. 

The SVD step 68 of this invention is then applied to the generated matrix X. Estimated 
eyelet profiles are contained within the rows of the matrix Vand these results are shown 
in Figure 9. It can be seen that three eyelet profiles 108, 1 10, 1 12 are extracted from the 

20 decomposed matrix V. Not unexpectedly, as SVD applied in the spatial domain is 
known to be unsuccessful in separating signals of the same period, these eyelets 108, 
110, 112 clearly do not correspond to the original source eyelets Ct, Cg, £3 shown in 
Figure 6. That is, SVD applied in the time domain is also unsuccessful in separating 
signals of the same period. Modulation envelopes are contained within the columns of 

25 the matrix U and these results are shown in Figure 10. Three modulation envelopes 
114, 116, 118 are estimated. From the similarities between two 116, 118 of the 
envelopes it is apparent that there is a large degree of signal leakage. 
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The reason for the failure of SVD to separate the signals is that it constrains both the 
modulation envelopes and eyelet profiles to be uncorrelated, or dissimilar. This is 
inherent in the SVD methodology as it is a second order decorrelation method, which is 
intended to remove all similarities between signal pairs in a set of signals. 
5 Mathematically, this means that the decomposed vectors are made orthogonal. In many 
real signals, either the envelopes or eyelet profiles (as in this example) will be similar 
(correlated) and so a solution that makes them dissimilar will not succeed in separating 
them. SVD also carries out a normalisation process, which forces normalised signals in 
the set to have the same power level. Singular values contained in the matrix X reflect 
1 0 relative power levels and so allows their detection. It is important to note that, although 
the eyelet profiles are correlated, they do still need to be different for SVD to decompose 
the matrix X. 

SVD does however generally provide some indication of the number of source signals in 
the composite signal. At step 72, shown in Figure 5, it will be recalled that relative 
1 5 power levels of the component signals are contained in the singular values and these 
are generally arranged in decreasing order along the diagonal of the matrix X. The 
number of source signals present, denoted by q, can be estimated by setting a threshold 
power level and determining the number of signals above it. In practical applications 
threshold estimation may be aided if the number of sources is known in advance. 

20 In summary therefore, period SVD, when applied to the problem of concern to this 
invention, first enables the correct period of component signals to be determined. 
Secondly, when the decomposed values of the correctly-partitioned matrix X are 
retrieved, it enables the singular values to be used to determine whether more than one 
periodic signal with this period is present in the composite. 

25 Despite the inability of SVD to separate signals of the same period, it has been 
discovered that SVD does provide an initial basis for their separation. The SVD in fact 
produces linear combinations of the eyelets c,, Cg, C3, whichever combinations comprise 
orthogonal vectors. The goal of the third stage 64 of BPM is therefore to recover the 
actual eyelets and their envelopes from these combinations. 

30 Referring once again to Figure 5, the SVD stage 62, extracts the number q of sources 
and q linear combinations of eyelets from the composite signal. In some applications it 
is however difficult to set a suitable threshold level, and so it is assumed that all singular 
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values correspond to sources. In such cases therefore either all decomposed signals 
are passed on to the next stage 64 or an estimated maximum number, for example, 30. 
To preserve the generality of the method it will be assumed in what follows that q signals 
are processed in the final stage 64, and 2<,q<,k. 

5 At the third stage 64, Independent Component Analysis (ICA) is performed on the 
decomposed l/and V matrices. ICA is again an analytical technique that is known from 
the prior art of BSS. BSS describes a process of extracting individual signals emitted by 
a number of statistically independent sources from some linear combination received at 
an array of sensors. At the heart of ICA is its assumption that the combined sources are 

1 0 statistically independent. To date, ICA has almost exclusively been applied to spatial 
problems: typically the separation of signals from multiple sources received at multiple 
sensors. A further assumption of ICA is that the signal combination mechanism is 
linear, instantaneous and time-invariant. If these assumptions hold then the time- 
domain partitioning described above creates a mixing model that is analogous to the 

15 spatial-domain multiple sensor case. This third stage 64 of BPM is based on a novel 
application of ICA to a time domain problem: a time sequence of data collected at a 
single sensor. In the prior, art, ICA has not been applied to single-sensor period 
estimation problems. 

As ICA is based on an assumption of statistical independence, it is important to analyse 
20 a property of the composite signal that, as far as possible, exhibits statistical 
independence. A first step 76 of the ICA stage 64 of BPM is therefore to determine 
whether it is the modulation envelope waveforms a, or eyelet profiles c, that are 
statistically independent. In most applications it is envisaged that one skilled in the art of 
signal analysis will know this in advance. In the case of machine condition monitoring it 

25 is most likely that the envelopes are more independent: components of machinery 
rotating at the same speed are likely to have similar eyelet profiles, but what they 
connect or interact with (the source of the modulation) will depend on where a particular 
component is within the assembly. Similarly, if multiple speech signals are carried in a 
single communications channel, the "acoustic" envelopes are unlikely to be correlated. 

30 On the other hand, in sonar applications, for example, in which a sonar pulse is 
corrupted by a multi-path signal, it is the eyelets that are more likely to be statistically 
independent. Since sonar can make use of narrow pulses then any time delay is likely 
to separate a pulse and its multi-path equivalent, which will therefore not overlap in the 
time domain. That is, the pulses will comprise eyelets with independent shapes in the 
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time domain. Without independent knowledge of the shapes or delays, the signals of 
period p will appear to be one signal. In addition, the statistics of multi-path 
. environments can change quickly and so only a few eyelet repeats would satisfy the 
requirement of having equal period for a valid separation. 

5 If it is the envelopes that are statistically independent, BPM then proceeds to step 78. 
This assumes that the amplitudes, contained within matrix U, are related to the true 
independent envelopes by means of an unknown rotation R 2 . Mathematically, Xis set at 
step 78 to: 

X=UR 2 T R 2 XV (6) 

1.0 where R 2 defines a unitary (q x q) rotation matrix and so R 2 R 2 = /, the identity matrix. It 
is also assumed that the columns of Xare zero-meaned. 

Once the matrix X has been formulated as described herein and then decomposed 
using SVD, at step 80 ICA is used to determine the hidden rotation matrix R 2 . As is well 
documented in relation to prior art applications of ICA, if signal combinations are linear, 
15 instantaneous and time-invariant, source signals cannot be separated using second 
order statistics. ICA is therefore based on higher order statistics (HOS), usually 
represented by cumulants of higher order than 2. 

ICA implemented in accordance with this embodiment of the invention is based on fourth 
order cumulants. Other implementations of ICA may also be used; it is not necessarily 

20 limited to fourth order statistics, but should make use of order three or greater. The 
procedure adopted to calculate f? 2 from the matrix U\s complex mathematically and well 
known in the prior art. Effectively R 2 is computed as an iterative sequence of pairwise 
rotations. Each rotation is designed to maximise the statistical independence of a given 
pair of modulation vectors a, within the matrix U. Statistical independence is measured 

25 by the corresponding pairwise contrast function. The procedure adopted by this 
embodiment of the invention follows that described by J. G. McWhirter, I. J. Clarke and 
G. Spence in "Multilinear Algebra for Independent Component Analysis" SPIE's 44 th 
Annual Meeting, the International Symposium on Optical Science, Engineering and 
Instrumentation, Denver, USA 18-23 July, 1999, but other ICA algorithms can also be 

30 used. As mentioned previously ICA, applied to spatial problems, is well known in the 
prior art. The specific details of applying ICA to the decomposed matrix X (as described 
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herein) will therefore be obvious to one skilled in the art. The inventive aspect of the 
present invention lies in the realisation that, despite the prejudices of the prior art, SVD 
and ICA can be applied to a time domain problem in order to separate signals with the 
same period. 

5 Once the rotation matrix R 2 has been found, BPM computes, at step 82, final estimates 
of the eyelets a* and modulation envelopes af. For q detected signals, the separated 
envelopes are contained in columns of a (k x q) matrix UR 2 T . The separated eyelet 
profiles are contained in rows of a (q x p) matrix R 2 X V. At step 84, separated envelopes 
af and / or eyelets c, e are passed to the analysis stage 1 8. 

10 In situations for which the modulation envelopes-are not independent the ICA analysis 
based on U, as described above, breaks down. This is because the requirement for 
statistical independence is not met. As with SVD, ICA removes similarities within a 
dataset. If the modulations therefore are correlated, signals will not be correctly 
separated. In such cases, separation is still possible however, based on independence 

1 5 of eyelet profiles. Accordingly, if it is the eyelet profiles that are statistically independent, 
BPM proceeds to step 86, instead of step 78, after the selection step 76. The ICA has 
to be modified in order that analysis remains based on independent components - in 
this case the eyelet profiles. At step 86 matrix Xis therefore set to: 

X= UkRiR/V (7) 

20 where R 1 defines a unitary (q x q) rotation matrix and so = /, the identity matrix. In 
this case, it is assumed that the rows of X are zero-meaned. 

As it is the eyelet profiles as opposed to the modulation envelopes that are independent, 
f?, is calculated at step 88 from the matrix V. This calculation is carried out analogously 
to that described previously: /?, is computed as an iterative sequence of pairwise 
25 rotations, each rotation being designed to maximise the statistical independence of a 
given pair of eyelet vectors c,- within the matrix V. 

Once the rotation matrix R 1 is found, BPM computes, at step 90, final estimates of the 
eyelets cf and modulation envelopes af. For q detected signals, the separated 
envelopes are contained in columns of a (k x q) matrix UkRi. The separated eyelet 
30 profiles are contained in rows of a (q x p) matrix R/V. The alternative ICA processes 
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then converge again and, at step 84, the separated envelopes a? and / or eyelets c? are 
passed on to the data analysis stage 18. This stage 18 employs known techniques that 
are used to extract information about the source of each signal component and to 
display results to a user. 

5 The full three stages of BPM were applied to the datastream used to generate the plots 
shown in Figures 6 to 12. Figure 11 displays a plot of three estimated eyelets c/, cf, 
cg e extracted from the composite signal 104 by BPM (version that exploits the 
independence of the envelopes). Comparison with the source eyelets Cj, Cg, eg of Figure 
6, which were used to generate the composite signals in the first place, readily reveals 

1 0 the success of this method. 

Modulation envelopes are contained within the columns of matrix UR 2 T and the results 
extracted by BPM are shown in Figure 12. Three estimated modulation envelopes 122, 
124, 126 are recovered. These acoustic signals are readily identifiable as having 
waveforms characteristic of speech 122, 124 and music 126. In fact the correlation 
1 5 coefficients between the orthonormal source modulations and their respective estimated 
modulations 122, 124, 126 are all greater than 0.99. The optimum correlation, 
representing perfect signal separation, is 1 .0. 

The ICA stage 64 of BPM therefore proceeds by one of two alternative routes. First, if 
the eyelets are correlated, signal separation (of eyelets and envelopes) is based on the 
20 independence of the envelopes. Secondly, if the envelopes are correlated, signal 
separation is based on the independence of the eyelet profiles. It is important to note 
that even although the eyelets or envelopes may be correlated, they must still be 
different for BPM to be effective. 



There is an additional advantage to be had in being able to use the independence of the 
25 eyelet profiles in the ICA analysis. Typically, to complete the analysis and make signals 
independent, at least 50 samples are required. If the independence of the envelopes is 
exploited, each sample used in an envelope vector (element within a column of matrix 
U) is associated with one eyelet segment (period p samples long). Thus, for an 
envelope vector to span 50 samples, 50 replications of the eyelet will be required. By 
30 way of contrast, if the independence of the eyelets is exploited, signal separation may be 
achieved using far fewer eyelet repetitions. For q source signals, signal separation can 
be achieved using q eyelet segments (of period p, assuming that p > - 50) 
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A helpful illustration of the mixing and then decorrelation process is shown in Figure 13. 
Figures 13a-d are each referred to as a scatter plot in which a time-domain signal is 
sampled and an instantaneous amplitude (envelope) of one source signal is plotted 
against that of another, at each sample time. Thus if one source has amplitude 3 and 
5 the second has amplitude 1 at a particular sampling time, a point is placed on the plot at 
position (3,1). Over an extended interval, a number of points appear on the graph as 
the number of sample times increases. Figure 13a is a scatter plot 128 of two random 
source signals which are not mixed. As can be seen, points are distributed over the 
area of the plot 128. Figure 13b is a scatter plot 130 of a composite signal when the two 
1 0 source signals shown in Figure 1 3a are mixed. In this case, data for one axis of the plot 
is taken from one column of the partitioned matrix X and data for the second axis is 
taken from another column. That is, the plot 130 shows a first combination of two 
envelopes, each weighted with one sample of their eyelets, plotted against a second 
combination of the envelopes. It can be seen that the plot 130 is far from an even 
15 distribution. Mathematically, the mixing in fact corresponds to a complicated 
combination of stretching, shearing and rotation! Figure 13c is a scatter plot 132 of two 
signals taken from the end of the SVD stage 62, 66 of processing. That is, the 
corresponding columns of Xto those used in Figure 3b are plotted after they have been 
made orthonormal: after X has been decomposed to a product UkV. It can be seen 
20 from this plot 132 that SVD removes the stretching and shearing caused by the mixing. 
Figure 13d shows a scatter plot 134 of the two columns after complete BPM processing. 
That is, of two columns of the rotated matrix 10?/. The effect of the hidden rotation 
matrix found by the ICA stage 64 can be seen to be alignment of the straight edges of 
the Figure 3c scatter plot 132 with the co-ordinate axes. This representation applies 
25 regardless of whether the ICA stage is based on the independence of the eyelets or of 
the modulation envelopes. 

As an aid to summarising the signal separation process, components of a computer 150 
arranged to carry out the separation and analysis are illustrated schematically in Figure 
14. The computer 150 comprises an interface 152 to allow a user to select optional 
30 processing steps as required, a datastream buffer memory 154 for storing digitally 
sampled output from the sensor (the composite signal) and four processing modules 
156, 158, 159, 160 for performing the BPM separation. This embodiment of the 
invention acts on a signal with components of only one period p. It can however readily 
be adapted to perform a prior art period separation process before execution of the 
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procedure described herein. The processing modules include a data partitioning module 
156, with access to the datastream memory 154, which is arranged to partition data 
within the datastream memory 154 in accordance with a set of test periods p'; an SVD 
processing module 158 arranged to decompose the partitioned datastream into a 

5 number of linear combinations of source signals; a period estimation module 159 
arranged to extract an estimate of the true period p of the periodic components of the 
composite signal and an ICA processing module 160 arranged to extract source 
envelope and eyelet profiles from the decomposed matrices U, V, X obtained from the 
^atrix-XHwhen-iHs^arttioned^n-^ 

10 computer 150 also includes two further memory units: a matrix memory unit 162 and a 
decomposed signal memory unit 164 for storing data output from the data partitioning 
module 156 and SVD processing module 158 respectively. In addition an analysis unit 
166 is arranged to analyse the data for fault indication or other further processing 
function. 



15 In carrying out the BPM signal separation process as indicated in Figure 5, the sensor 
output in the form of sampled intensities is written to the datastream memory 154. The 
data partitioning module 156 accesses this data and, for each test period p', partitions 
the data to form a matrix X tesl . It then writes the data within each segment to a row of 
the matrix memory unit 162. The. SVD processing module 158 accesses the data 
20 stored, as matrix X, es t, in the matrix memory unit 162 and performs a singular value 
decomposition of this matrix X test . Results, in the form of amplitude data, profile data 
and source strength data are written to the decomposed signal memory 164. For each 
matrix X, est , the period estimation module 159 calculates a weighted average of the 
profiles stored to obtain a likelihood indicator of a particular test period p'. Once the 
25 entire set of test periods have been assigned a likelihood indicator, an estimate of the 
true period is made as that test period which has the maximum likelihood indicator. The 
decomposed data within the decomposed signal memory 164 that corresponds to that 
derived from the matrix X partitioned in accordance with the estimated period p is 
highlighted by the period estimation module 159. The period estimation module 159 in 
30 addition accesses the source strength data in the decomposed signal memory 1 64 and 
estimates the number of signals that are present at this period p i.e. how many of these 
highlighted singular values exceed a preset threshold. The components of the 
decomposed matrices that correspond to the number of estimated sources are also 
highlighted in the decomposed signal memory 1 64. 
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The ICA processing module 160 accesses the highlighted stored amplitude and profile 
elements for processing. Again either the amplitudes or profiles are processed, in 
response to a selection made by the user via the interface 152. After the ICA 
processing is complete, data relating to the separated eyelets and envelopes is sent to 
5 the analysis unit 1 66 for analysis and / or display. 

» 

In considering the BPM process described herein, it is apparent that if the period were 
estimated in advance of the SVD stage 62 (Figure 5), then only a single SVD need be 
carried out on a correctly partitioned matrix. That is, we may be able to improve the 
computational efficiency of the analysis. As mentioned previously, period estimation 
1 0 techniques are well known in the prior art and any of a number of them can alternatively 
be used. Most of these period estimation techniques are based on the principle of 
synchronous averaging. A second embodiment (not shown) of this invention 
accordingly makes use of synchronous averaging. 

A synchronous averaging step is performed prior to the SVD stage 62. As in the 
1 5 previous embodiment, the datastream is divided into a number of segments, the size of 
each segment corresponding to a test period. If the test period is equal to the true 
period, coherent integration can be achieved simply by averaging the segments. If the 
test period is, for example, half the true period, alternative segments (period p/2 
samples) will contain the same half of the eyelet profile. Thus, averaging these 
20 segments will also produce coherent integration, but the combined average of the 
segments will not be coherent. The test period which gives rise to the highest average 
value of the segments may be taken as an estimate of the true period p. However, 
coherent integration also occurs at multiples of the true period, which can affect results: 
i.e. if the test period is a multiple of the true period, segments will contain an integer 
25 number of replicated eyelets and averaging these is effectively equivalent to the 
averaging process at the true period. 

It then follows that to detect a true period, a detection method should be used, such as 
the "small-to-large" technique described by Sethares et al. (mentioned previously). In 
this technique, to avoid detecting periods at multiples of the true period, the search is 
30 commenced from short to long test periods, hence the term 'small-to-large'. 

Thereafter, only the correctly-partitioned matrix X is passed to the SVD stage 62 of 
analysis. The ICA stage 64 is unchanged and proceeds on the basis of which 
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parameter is statistically independent. 

The computer system 150 illustrated in Figure 14 is in fact capable of analysing the 
datastream in accordance with either embodiment of the invention. If the user selects 
period estimation by synchronous averaging, then the period estimation module 159 . 

5 averages the data stored in the matrix memory 162 rather than in the decomposed 
signal memory 164. Note that this average is not weighted. Once the period is 
estimated, on the basis of the maximum likelihood indicator from the set of test periods 
p\ the correctly-partitioned matrix is highlighted within the matrix memory 162. The SVD 
processing module 158 then performs an SVD of the highlighted matrix X and, as 

1 0 before, writes the output data to the decomposed signal memory 1 64. 

The disadvantage of synchronous averaging is that it cannot be used effectively if 
negative eyelets are anticipated. Cyclets with negative amplitudes (scalings) often arise 
in signals propagating through a medium. They are frequently encountered in sonar 
when multi-path reflections corrupt the original signal. In many other applications, the 

1 5 signal amplitude is measured about a subtracted mean and accordingly negative values 
result. In such cases, even at the true test period, positive and negative amplitude 
segments will average destructively. Coherent integration is limited and synchronous 
averaging may not generate distinctive peaks in the period likelihood estimate. By way 
of contrast, the period SVD method overcomes this limitation of synchronous averaging 

20 as it processes pairs of vectors; relative scalings of each eyelet pair are determined 
before they are combined. Accordingly the first-described embodiment that makes use 
of period SVD is preferred. 

As detailed above, the main benefit of BPM over prior art methods of signal separation 
is that it succeeds when applied to data received at only a single sensor. However this 

25 is not to say that multiple sensors cannot be used, indeed there is even a benefit to be 
had in reducing noise. In an implementation in which data is gathered at multiple 
sensors, BPM is applied in parallel to each datastream. The replicas of the estimated 
cyclets and / or envelopes obtained from each sensor recording may be averaged in 
order to suppress noise. For a eyelet repeated k times across m sensors, there are mk 

30 degrees of freedom to suppress noise, as opposed to only k degrees in the single 
sensor case. There are however two distinct separation scenarios which must be 
considered before the averaging is done. 
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In the first case, referred to as instantaneous mixing, different sensor outputs (channels) 
can be considered as consisting of replicas of the composite periodic signal but with 
different additive noise and different attenuations. The latter difference arises from the 
different propagation paths to spatially separate sensors. This scenario is represented 
5 in Figure 15. In this Figure, two sources (not shown) generate one signal comprising 

eyelets cj and modulation amplitudes (a11, a12, a1k) and another comprising 

eyelets eg and modulation amplitudes (a21 , a22 a2k). Referring first to Figure 1 5a, 

there is shown the two, source signals 170a, 172a arriving at a first sensor 174 and the 
corresponding source signals 1 70b, 1 72b, with different attenuation, arriving at a second 
1 0 sensor 176. The different attenuations can be represented by weighting the amplitudes 
of each signal 170a,b, 172a,b by a factor w/y, where / indicates the source of origin and j 
indicates the sensor of reception. As indicated in Figure 15b, in this case, segments 
from both (y = 1 , 2, in this example) channels can simply be partitioned to form a (2k xp) 
(more generally (Jk x p)) matrix X. BPM can then be carried out as before on the input 
1 5 matrix X. 

In the second scenario, the composite periodic signal arrives at different times at 
different sensors. Different sensor outputs can be considered as consisting of replicas 
of the periodic signal with different noise, attenuation and also time delays, the latter two 
both being caused by the different propagation paths to the sensor. Partitioning to use 

20 segments from all channels in the input matrix X cannot be exploited in this case. The 
time delays on different channels will mean that eyelet replicas from different channel 
recordings would be misaligned within the matrix X. Attempting to separate such a 
misaligned matrix X has two consequences. First the number of source signals will 
appear to increase. This arises as a delayed replica of a signal will appear to be distinct 

25 from the actual (undelayed) signal. Secondly, since replicas of the same eyelet are 
misaligned there will be non-coherent integration within the synchronous average step. 
In this scenario it is therefore necessary to perform two separate BPM analyses: one for 
each sensor channel. Time delays for each replica can then be obtained using known 
techniques and a correction applied. Corresponding source signals can then be 
30 averaged. 

In illustrating the analysis performed by the BPM, it has been assumed that the eyelets 
within each signal start at the same time. That is, the scaling factors a1 1, a12, etc and 
a21, a22, etc occur synchronously between respective signals. If this is not the case 
and the eyelets in a first signal begin at different times to those in a second signal, the 
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BPM process is still able to separate the signals. As will be explained in more detail 
below, for each signal that is misaligned with the partitioning process, applying the BPM 
will result in an estimation of two separated signals. These two signals essentially 
correspond respectively to sum and difference components of the source scaling 
5 factors, with associated eyelets and singular values. In the majority of cases, most of 
the energy will be in the sum component; the difference component will be associated 
with a smail singular value and can be neglected. Even if this is not the case, the BPM 
has only linearly decomposed the misaligned source signal and the two estimated (sum 
and difference) components may readily be associated and combined. 

10 To illustrate in further detail the BPM analysis of misaligned signals, consider first a 
situation in which two signals with the same period are mixed in a single time series. 
For this illustrative example, it is assumed that both replicated eyelets have a period of 
100 samples but that the eyelet eg has a different starting time from eyelet Cj. If we 
denote the samples within each eyelet vector c, T as [c,<0), c,<1), c,<2) c,(99)], the 

15 amplitudes aij, as before, and the datastream itself as the (kp x 1) vector d, where the 
symbols k and p have the meanings assigned previously, then if d is partitioned to form 
the matrix X, we have Equation (8) below: 

" all[ Cl (0), c, (1), c, (2), ... c t (99)] + a21[c 2 (75), ... c 2 (99)]a22[c 2 (0), ... c 2 (74)] 
al2[c 1 {0),c 1 (l), c 1 (2),...c 1 (99)] + a22[c 2 (75),...c 2 (99)]a23[c 2 (0),...c 2 (74)] 



20 (8) 

where it can be seen that each segment (of the two represented as rows of the matrix X 
above) comprises the sampled amplitudes within the first eyelet c, r , starting at t = 0 
added to synchronously sampled amplitudes within the second eyelet c/. The second 
eyelet is displaced 25 sample points from the first. In this way, in the first segment, 
25 sampled points o>(75) to Ca(99) are weighted by the amplitude a21 and added to the first 
25 sampled points of the first eyelet c/, whereas sampled points ea(0) to Pz(74) are 
weighted by the amplitude a22 and added to the final 75 sampled points of the first 
eyelet c, T . This is because the start of this eyelet c/ and the partitioning process are 
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offset by 25 samples. 

From Equation (8) above it can be seen that each row of X contains a combination of 
the two eyelets and Xcan also be expressed as: 



X = 

a2l' 
a22 



a11 
a12 



[c l (0),c,(1),c,(2), 0,(99)] + 



[c 2 (75),...C 2 (99),0 0] + 



a22 
a23 



(9) 



[0, 0,c 2 (0),...c 2 (74)] 



5 where the second component has eyelet vector with 75 samples of zero amplitude and 
the third component has its first 25 samples of zero amplitude. Thus, the matrix X is 
effectively made up of three periodic components. The first periodic component consists 
of eyelet c, and the remaining periodic components consist of adjacent sections of the 
eyelet c 2 . This arrangement arises as a consequence of the starting point of c 2 not 

10 being aligned with the partitioning process and because modulations are varying. It can 
be observed that X is effectively a three rank matrix. Neither the amplitudes nor the 
eyelets of the latter two components (which belong to the same source signal) are 
independent: separation using BPM should, theoretically, prove difficult. 

If however the modulations of the eyelet £2 are slowly varying (i.e. if a21 - a22 - a23) 
15 then adjacent segments of c 2 can be combined. The partitioned matrix X can be 
expressed as: 



all 
all 



[c l (0),c 1 (l),c l (2) c t (99)] + 



a22 
a23 



[c 2 (75),...c 2 (99),c 2 (0),...c 2 (74)] (10) 



This formulation is similar to that shown in Equation (2) and the BPM can be used to 
20 separate the eyelets. Thus, effectively, with slowly varying modulations, the BPM will 
separate a non-aligned signal into one in which derived weightings are effectively 
averaged over the two eyelet amplitudes present in one segment. 
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If, on the other hand, the modulation is highly non-stationary then the non-aligned signal 
is still separated, although not so straightforwardly, by the BPM. Such a highly non- 
stationary modulation can however be directly exploited by making use of the BPM 
version that is based on the independence of the modulation envelopes. 

5 Using the same notation as before, consider a single non-aligned signal with eyelets c 2 . 
The partitioned matrix Xcan be expressed as: 



X = 



a21[c 2 (75), . . . c z (99)]a22[c 2 (0), . . . c 2 (74)]' 
a22[c 2 (75), . . . c 2 (99)]a23[c 2 (0), . . . c 2 (74)] 
a23[c 2 (75), . . . c 2 (99)]a24[c 2 (0) , . . . c 2 (74)] 



(11) 



In this example, X consists of two periodic components: the first example spanning 
samples 75 to 99 of c 2 and the second spanning samples 0 to 74 of c 2 . The 
10 modulations of two components in Equation (11) can be rewritten, by comparison with 
Figure 4 and Equation (2), as: 



A = \a 2 a 3 ) = 



a21 a22 
a22 a23 
a23 a24 



(12) 



Where A denotes the mixing matrix. One of the modulation vectors is delayed by one 
sample point with respect to the other modulation vector a 2 . If the modulations change 

15 abruptly then the two columns in Equation (12) will be sufficiently distinct to create two 
components in the analysed data, albeit that they will belong to the same replicated 
eyelet. Additionally, it is unlikely that these modulation vectors will be independent of 
each other. For this example, applying the BPM that is based on the statistical 
independence of the modulations, a pair of independent temporal modulation (basis) 

20 vectors would be generated that belong to the same signal. In order to recreate the time 
series for a single replicated eyelet, these independent modulation vectors will have to 
be combined. This is a straightforward task for a single signal. The BPM has simply 
linearly decomposed the data into a pair of independent temporal modulation vectors. 
The two signals can be expanded using the corresponding singular values and the 
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corresponding eyelets and simply added together. 

If a second signal is present then there is first a need to determine which of the 
"independent" basis vectors are actually associated and so should be combined to 
recover the non-aligned signal. Despite this complication, the BPM has in fact achieved 
5 signal separation. It is only that two independent basis vectors are created for eyelets 
with a start that does not coincide with the partitioning process. 

One method of identifying and combining the associated base vectors may be 
appreciated by considering the following analysis. First, define the two separated (k x 1) 
modulation vectors of the same signal as a 2 = a(k) and a 3 = a(k + 1), where the 
10 argument (k + 1) simply indicates that this vector is delayed by one sample with respect 
to a(k). Using a Taylor expansion up to first order for a about k, a(k+ 1) can be 
expressed as: 

a(k+1)«a(k) + ^(k) (13) 

where a^k) denotes the differential of a(k). The two vectors a(k) and a(k + 1) can be 
1 5 more readily expressed as: 



[a(k) a(k + 1)] - [a(k) a(k) + a'(k)] 

1 1" 



[a(k)a(k) + aU)]-[a(k)a(k)] 



0 1 



(14) 



where each modulation matrix is applied to modulations of the same eyelet. An 
alternative way to view the (k x 2) matrix consisting of a(k) and a(k + 1 ) is the mixing of 
two components a(k) and ff(k) by a (2 x 2) matrix. In this case, the BPM will estimate 

20 two modulation vectors and these are effectively the sum and difference components, 
albeit that they will be made independent of each other. Signal association is though 
made possible by the fact that one modulation vector is effectively the (independent) 
differential of the other. This should enable their identification in the complete separated 
signals matrix. It is readily seen that if the modulations are slowly changing then most of 

25 the energy will be in the sum component and recombination of the sum and difference 
components is not required. That is, the situation reduces to the previous one in which 
an average amplitude was found. 
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Figures 16a) to d) illustrate signal separation by the BPM for a case in which the start 
times of the replicated eyelets (signals) differ. These plots (Figures 16a) to 16d)) are 
simulated in a comparable way to the data shown in Figures 6 to 12. Figure 16a is a 
plot 180 of three simulated source modulations 182a, 182b, 182c. These are applied to 
5 respective replicated eyelets (not shown), which shall be referred to as Cj, eg and £3. 
The offsets between the start of a signal eyelet Si< which is aligned with the partitioning 
process, and the starts of the other signals Cg, £3 are 1 1 and 27 samples respectively. 
Figure 16b is a plot 184 of the mixing of the three modulation envelopes. That is, it is 
generated by plotting values found in a column of matrix X. This is in the same way as 
10 the plot 106 shown in Figure 8 is generated, but using the different modulations 182a, 
182b, 182c and offset eyelets Cj, Cg, fe. After the SVD stage 62 is applied to the 
simulated matrix X, estimated modulation envelopes, contained within the columns of U, 
are shown in Figure 16c. Three modulation envelopes 188a, 188b, 188c are estimated, 
which it is apparent are not the same as the original source modulations 182a, 182b, 
15 182c. By way of contrast, Figure 16d) shows modulations 190a, 190b, 190c estimated 
using the BPM method. As stated above, the BPM estimates, for each of the offset 
signals, the largest (sum) component only. The modulations 190a, 190b, 190c plotted in 
Figure 16d are evidently very similar to the original source modulations 182a, 182b, 
182c shown in Figure 16a. In fact, the correlation coefficients between the orthonormal 
20 source modulations and the estimated "sum" modulations were measured at 1 , 0.93 and 
0.95. It can thus be seen that there is very little error introduced by estimating only the 
"sum" component of a non-aligned signal in the BPM analysis. 
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